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ABSTRACT 

A latent trait model is described that. is appropriate 
for use with tests that measure more than one dimension, and it£ 
application to both real and simulated test data is demonstrated. 
Procedures for estimating the parameters of the mo3el are presented. 
The research objectives are to determine whether the two-parameter 
logistic model morg^ adequately explains multidimensional test data 
than does the unidimensional version of the model, and to determine 
whether the results yielded by the application of the model are 
consistent with the results of another, more established multivariate 
data reduction procedure, factor analysis. The results of *the 
-analyses of the simulation data indicated that the parameters of the 
multidimensional model could be accurately estimated. The results of 
the goodness of fit analyses indicated that the multidimensional 
model could more adequately model simulated multidimensional response 
d^ta than could the unidimensional model. The results of the analyses 
of the real^data indicated that the multidimensional model also more 
adequately modeled multidimensional real data than did the 
unidimensional model. It was concluded th>t the use of a 
multidimensional model does seem to.be feasible, and that more 
research is warranted. (Autljgr/PN) 
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i • i 

A study wr.* conducted to investigate the feasibility of a ' * 1 
multidimensional IRT model. A two-parameter logistic IRT model and 1* 
a multidimensional extension of th.it model^were selected for this • * 1 
.research, the design of the study employed two. stages. The first* I 
stage consisted of generating simulation data to f Jt "the multidimensional 1 " 



DD 1473 



EDITION OF I NOV 65 IS OBSOLETE 

S/N TJ102- LF»0N-6601 



SECURITY CLASSIFICATION OF THIS PACE (Whty Dmtm Enffd) 



model, 'applying the model to tjie data, and. "comparing the resulting 9 * : 

estimates to the "known parameters. The unidimensional model was also 
applied to these data. t In addition to comparing the parameter estimates 
to the true parameters, the fit of the 'unidimensional and multidimensional 
models to the data were compared. The second stage 'o£ the study employed 
real response data. Items were selected, from various subtests of a 
large test s^ as- to simulate shorter tests with varying numbers of 
dimensions. . Both models were applied to these data, and the resulting 
"estimates w^re used to evaluate the fit of the models to the data. 
The results of tlje analyses <-of the simulation data indicated that the. 
parameters of the multidimensional model could be accurately estimated.- 
The Results of the goodness of fit analyses indicated *hat the 
multidimensional model could more adequately model simulated 
multidimensional response data than could tHe unidimensional model. 
The results of the analyses of -the real data indicated that the 
multidimensional model also more adequately modeled multidimensional 
real data than did' the unidimensional model. It was concluded that 
the use of a # multidimensional model does oact seem to be feasible, and 
that more research was warranted^ v 
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, An Application of a Multidimensional Extension, 
of the Two-Parameter Logistic Latent Trait Modei 



Latent trait theory has become an* increasingly popular 
area for re'search and application in recent years. Areas • 
where latent* trait theory has been applied include test 
scoring (Woodcock, 1974), criterion- referenced measurement 
(Bambleton, Sjvaminathan, Cook, -Eignpr, and Gif f o'rd, 1978), 
•test equating (Marco, 1977; RdEbtz^and Bashaw-, 1977), 
tailored testing (McKinl^y and Reckase, 1980 j , and mastery , 
testing (Patiencfe and Reckase , 1978 ) . , WhiLe many of these f 
applications have been successful, one unsolved problem is 
- repeatedly encountered. Most latent trait models assume a 
unidimensional latent trait'. As a result, applications of 
these models, have been limited to areas in which 'the tests 
used measure" predominantly one factor. When the assumption 
of unidimensionality is not met, ' such as is often. the case, 
with achievement . tests-, most latent* trait models are 
inappropriate. • 

The purposes of the research presented here are to 
describe a latent trait models that> is appropriate for use 
with tests that measure more, than one dimension and t.o 
demonstrate its application to both real and simulated test 
data. In addition, procedures" for estimating the parameters 
of the model will be presented. * • . 

Trie objectives of this research are / to determine whether 
the proposed model more a'dequat^ly explains multidimensional 
& test data 'than does the undimenkional version "of the model, 
and to determine whether the results yielded by the. . 
' application of the' model are consistent with the .results of 
another, more .established multivariate data reduction 
procedure, factor analysis. 

Method ' 

" The Model - 

. The unidimensional model selected fcsr this study, the 
. two-pa /arnet logistic (2PL) model, is given by * x 

... V exp(Da. (O.-b.)) § 

• • P i > (e j )=— : -~ , ,(D 

l+exp(Da i (e j -b i )) . , 
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whe 



re a . is the discrimination parameter for item^i, b. is 

i ■ . i 



the difficulty "parameter for item i, 8.. is the ability. 

parameter for examinee j, and D=\.7 . • * ) 

The multidimensional model Selected for this study, a 
multidimensional extension of the two -parameter logistic 
(M2PL) model, is' given by 

i 

exp(d. +a . 8 . ) 

* ■ 1 1 J 

vv = — ~~ ' r ' (:?) 

J+exp(d i +a i 8 .) ^ , 

where P. (8.) is the probability of a correct response to t ^ 
item i by examinee j, d. is a parameter related to the 
difficulty of item i, a.^ is a vector of item discrimination 
parameters for item i, 8. is a vector of ability parameters 
for examinee . j , and 

m $ . 

. a i°j = k z =1 a ik e j k - "• ' (3) 

*■ * 

where a., is the discrimination parameter for item i on 
ik 

dimension k, 8 is the ability parameter for examinee j on 

J K * 
dimension k, and m is the number of dimensions modeled. 

Estimation Pro cedures \ 

\ 9 

The procedure used for item parameter estimation for the 
M2PL model is a modification of the marginal maximum 
likelihood procedure proposed by Bock and Aitkin (1981). 
Their procedure was modified, to make it. appropriate for use 
with the logistic distribution rather than with the normal 
distribution. * The ability estimation procedure used for the 
M2PL model is a conditional maximum likelihood estimation 
procedure. It employs an iterative estimation routine based 
on the Newton-Raphson technique. A complete description of 
the ability estimation procedure is included in ^VIcKinley and 
Reckase (1983) . ■ 

For the 2PL model, parameter estimation was performed 
using the LOGIST .estimation program (Wood, Winger&ky, s and 
Lord, 1976). This procedure is the most commonly used 
procedure for estimating the parameters of the three- 
parameter logistic (3PL) model. It can be used for 
estimating the parameters of the 2PL model by holding the 
? pseudo-guessing' 1 parameter constant, at zero. » t 
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Design ' ^ 

The general design of this study involved two stages. 
The first stage, employed simulation data with known true 
item and person parameters. The second stage involved the 
use of real test data, sampled to have specified numbers of 
subtests ,in order to contr.ol.to some degree the factor 
structure of the tests. * 

In the first stage of the study .response data with one, 
two, and three dimensions were generated using the M2PL / 
model and known parameters. The parameters of the 
unidimensional and multidimensional forms of the model were 
estimated for these data, and the resulting sets of 
estimates were compared to the true parameters and tc each 
other. 

In the second stage of the study actual response data for 
a large, test with 'several subtests were sampled in such a 
■way as to simulate tests having one, ;two, and three * 
subtests. Although the tests were simulated, the item 
responses were actual item responses from an administration 
of the large tesi:. The p~ nmeters of the 2PL and M2PL 
models were estimated, and the resulting estimates were 
compared with 'each other. 

, Datas»ets t ' y y 

Six datasets were employed in this research, three 
containing simulated item responses and three containing 
real item responses. One simulation dataset was generated 
to have one dimension, a second was generated to have two 
'dimensions, and a third dataset was generated^to have three 
dimensions. The first real dataset was constructed so as to 
have only one content area, the second had two content \ 
Areas, and the third had three content areas. 

*\ 

The true item parameters for the •simulation datasets were 
selected in the following- way. The d-paramete^s were * ■ 
selected from a table of the standard normal distributions 
They were sampled 'to have a mean of approximately- zero and a 
standard deviation of approximately ,5. The a-parameters , 
or discrimination parameters, were selected so that each 
item would have a high discrimination on only one dimension, 
and a low : discrimination on the other two dimensions'. For 
the unidimensional data only the devalues and the a-.valu<es 
for the first dimension 'Were used for data generation. For 
the two-dimensional data the 5ne-dimensional data- item 
parameters" were used along wp.th„ the a-values^for the second 
dimension. Thp three-dimensional data were generated using 
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the two-dimensional data item parameters along with the a- 
values fbr the third dimension* All three" simulation 
datasets ir eluded data^for 50 items and 1000 examinees. 

For the real data,sets, .item responses were sampled from 
Form 16 of the Texas Grammar, Spelling,, and Punctuation 
^-GSP) test (University of Texas, 1978). For the real 
dataset having one content, area, response data for the 
spelling subtest of the GSP test were sampled for 1000 
examinees and 30 items. For the two-subtest dataset, data 
were sampled for 1000 examinees for ,15 items from the 
spelling subtest and 15 items from the grammar subtest of 
the GSP test . For the three- subtest dataset, response data 
were sampled for 10Q0 examinees f t or 10 items from the 
spelling subtest, 10 items from the grammar subtest, and 10 
items from the punctuation, subtest of the GSP .test. The 
items that were selected were those items having the highest 
factor loadings on the first factor from a principal 
components analysis performed on the individual subtests . 
The principal components analyses were performed on phi 
coefficients. * 

Analyses 

Simulation Data Analyses The first analysis performed on 
the simulation data was to compare the item and person 
parameter estimates obtained for both the 2PL and the M2PL 
models to the known true parameters. • To „f aci litate these 
and subsequent analyses, the item parameter estimates f or - 
k the 2PL model were put in the M2PL form by multiplying the' - 
a- and b-values together ^o obtain' a d-value. Of course, 
some differences in scale between the two models were still 
expected, due to the presence of the D term in the 2PL 
model. The d-parameter estimates were compared to each 
other and to the true d-parameters using Pearson product 
moment 'correlations. . The correlations obtained for the two . 
models were compared using at- test (using Fisher's r to z 
transformation) . For the unidimenSional data ^the a- 
parameter estimates were compared to each other , and to the 
true a-parameters using the same 'procedure. 

For the multidimensional data there 'were different 
numbers of a-parameter estimates • for the unidimensional and 
multidimensional forms of the model. Therefore, there was 
no one-to-one correspondence 'between the two sets of 
estimates. Because of this, "correlations between the two - 
sets of estimates woyld not h4 meaningful for evaluating the 
quality of the estimates. However, such dorreLations might 
lead to a better understanding of the relationship between 
the two forms of the model. Therefore, the intercorrelation 



matrices for the a-parameter estimates were computed for the 
multidimensional data. 

Another analysis performed on the simulation data was the 
computation , for each model , of a mean absolute devi at ion 
(MAD) - statistic. Tl?is statistic *is given by 
. . % ' 

n , * . - 

MAEK -fc Z IP. -x. . | , • (4). 

J=l . . . L 
* • * . x 

where is 'the probability of .a correct response to item i 

by examinee j given -the i,tem parameter estimates obtained " 
for the model of interest, x. .> is the observed 'response to 

i-tem' i by examinee j, I^AD^ rs t,he moan absolute deviation 

statistic for item i,. and is thef number of examinees. _ 
This 'statistic, an indicant of 'the ability of the models to 
predict item responses, was computed for all items for both 
the" 2PL and M2P& models, and the meatf MAD statistics for the 
two models were compared for the simulation" data using 
analysis of Variance .techniques. In addition, a principal 
tomponents solution was -obtained on phi coefficients 
computed for each dataset." A varimax rotated factor 
solution was also obtained, and used to facilitate the 
interpretation of the results of the other analyses.- 1 The 
number of factors rotated was/ equal to the number of 
dimensions us&d to generate the d^ta. 

Real Data Analyses For the real data the true parameters 
were not known. Therefore, the first arialysis performed on 
the»re£'l data was the computation of the MAD statistics. 
The MAD statistics for the two models were once again 
compared using analysis qJ? variance techniques. A principal 
components analysis was al'so^ performed for each of the real 
datasets, and the varimax rotated factor solution was used 
to, facilitate interpretation of the results. The number of 
factors rotated was equal to the number 'of subtests included 
in 'the data . 1 ^ 

R esults 

Simulation Data Analyses " , 

True* Item . Parameters The true item parameters that were 
used to • generate, all of the ^simulation data are shown in 
Table 1. The d-parameters .*€hat are shown were used for all 
three simulation datasets. 3 The first a-parameter column 
contains the item discrimination parameters used to generate 
the one-dimensional data. The second" a-parameter column 
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«5, 



contains the item discrimination parameters that, along With 
^the first set of item, discrimination parameters, were use.d 
to generate the two-dimensional dataset. The third column 
of a-pafcamete^rs were used with the first two sets to 
generate the three-dimensional dataset. 



# , Table 1 

True Item Parameters Used to. Generate 
Item Response Data 
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Table 1 (Continued) 
True Item Parameters Used to Generate Simulated. 
Item Response Data" 
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Tablje-^1 also shows the means and standard deviations of 
the.* -f rue item parameters. As can be seen, all of th£ item 
parameters had similar means and standard deviations. 
Dimensions- 2 and 3 had mean a-values that were slightly 
lower than the mean a-valiies for dimension 1, with the 
dimension 3 a-values having the lowest mean". Dimension 3 
also had the highest a-value standard deviation. 

Table 2- sfiows the intiercorrelation matrix for -the item 
parameters shown in Tab}.e 1. As can be seen, there is_np ■ 
correlation between the true a-parartieters and the true d- 
parameters ( r=0 . 03 for dimensions 1 and 2, r=-0.03 for 
dimension '3 ) . 'The a-parameters^f or the different dimensions 
were moderately negatively correlated. The a-parameters had 
correlations of -0:45 for dimensions 1 and 2, -0.51 for 
'dimensions 1 and 3, and -0.50 for dimensions 2 and 3. The 
negative correlations among the a-values are a reflection, o'f 

12 
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the fact that items were simulated so as to have high a- 
values on only one dimension. 

\ ■ ■ • " 

•TSble 2 

Intercorrelation Matrix for the True Item Parameters 
Used to Generate the Simulated Item Response Data 

\ , 



Parameter d I a^ - a^ a 3 



d 1.00 • 0.03 0.03 -0.03 



1.00 -0.45 -0.51 

1.00 -0.50 
a„ 1^00 



a l 
a 2 
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Factor Analyses Table 3 summarizes th.e results of the 
factor analyses performed on the simulation datasets that 
were generated using tJ^e item parameters shown in Table 1. 
For the one-dimensional^ai^a^the factor loadings that are 
shown are for the first principal- component from a principal 
components analysis of phi coefficients^^ For the two- and 
three-dimensional data the loadings shown V^from a varimax 
rotated principal components solution, 

For the one-dimensiorial data the first two eigenvalues 
from the principal components /analysis were 6.54 and 1.34. 
These data appear to at least approximate unidimensionality. 
For the two-dimensional data "the first three eigenvalues 
were 8.07, 4.03, and 1.25. These, data clearly do not 
approximate unidimensionality. ^ For the three-dimensional 
• data the first four eigenvalues were 9.12, 4.51, 3.81, and 
1.03. Again, these data are clearly not unidimensional . 



C 
( 

) 



13 



V 



\ . * -9-' 

Table 3 

Factor Loadings Obtained for the One-, Two-, and Three- 
Dimensional Simulated Item Response Data 
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2 




0.20 


0. 


09 


0.57 


-0. 13 


0. 


04 


0.52 


3 




0. 07 


0. 


06 


0. 19 


0.05 


0. 


58 


0.07 


4 




0.56 • 


0. 


54 


0. 10 


0.56 


0. 


08 


0.09 


5 




0.20 


0. 


14 


0.53 


0.09 


0. 


08 


0 ; 56 


6 




0. 07 


0. 


11 


0. 13 


0,05 


0. 


59 


0.05 


7 




0\ 55 


0. 


60 


0.01 


0.55 


OJW 


-0.02 


8 




0 . '22 


0. 


11 


0.57 


0. 12 


0. 


04 


0/60 


g 




0.22 


0. 


25 


0. 12 


0. 1.1 


0. 


64 


0.03 


10 




0 . 62 


0. 


58 


0.11 


.0. 61 


0. 


09 


0.03 


11 




0 . 12 


0. 


10 


0.56 


0.08 


0. 


08 


0. 54 


12 




0.18, 


0. 


12 


0.05 


0. 13 


0. 


54 


0.08 


13 




0. 55 


0. 


57 


0.06 


0. 55 


, o. 


06 


0. 10 


14 




0.15 


0. 


06 


0.47 


0. 16 


"0. 


04 


0.49 


15 




0 . 08 


0. 


06 


0.04 


.0.11 


0. 


57 


0.08 


16 ■ 




0 . 62 


0. 


60 


0.07 


0. 58 


0. 


11 


0. 15 


17 


• 


0 . 25 


0. 


14 


0.59 


0. 10 


0. 


10 


0.6-1 


18 




0 . 19 


0. 


15 


0. 13 


0.08 


0. 


58 


0.04 


19 




- 0.57 s- 


0. 


, 58 


0. 15 


0. 58 


0. 


. 13 


0.05 . 


20 




0 . 18 . 


0. 


. 17 


0.50 . 


'0.16 


0. 


.01 


0. 53 


21 




0 . 03 


-0. 


.01 


. 0.24 


0.01 


0. 


. 56 


0. 16 


22 




0 . 58 


0. 


. 56 


0.07 


0. 59 


0. 


. 13 


0.04 


23 




0 . 19 


0. 


. 04 


0. 66 


0. 12 


0. 


. 10 


0.55 


24 , 




0. 19 


0 


. 18 


0. 06 


0. 09 


0 


. 62 


0.05 


25 




0. 53 • 


0 


.56 


0. 07 


0. 52 


-0 


.02 


0. 10 


26 




0.21 


0 


. 16 


0. 60 


0. 11 


0,06 


0.61 


27 




0. 12 


0 


.05 


0. 13 


0.01 


0 


. 62 


0.08 


28 i 




0 -. 60 • 


0 


.55 


0. 14 


0.61 


0 


. 02 


0. 15 


29 \ 

30 \ 

31 ' 




0. 17 


0 


. 14 


0. 62 


0.11 


0 


.04 


0. 60 




0.23 


0 


. 17 


0.16 


. 0. 14 


0 


. 60 


0.05 




0.48 


0 


. 50 


0.09 


0.50 


0 


.07 


0. 15 


32 ' 




0.00 v. 


0 


.04 


0. 54 


0.02 


0 


.04 


0 ,,49 


33 \ 




■ 0.24' 


■ 0 


.23 


0.08 


o: ii 


o 


.57 


. 0 . 09 


34 \ 




0. 64 


0 


. 63 


0.08 


0. 63 


• 0 


.04 


0. 15 


35< 




0. 17 ' ■ 


0 


. 11 


0. 62 


0. 10 


0 


.07 


0.56 


36 




0. 17 


c 


. 16 


0. 15 


0. 12 


. 0 


. 58 


. 0.07 


37 




0. 54 


0 


.56 


0.06 


0. 55 


0 


. 12 


0.09 


38 




0.16 


0 


.09 


0.58 


-0.01 


0 


.09 


0.54 


39 




0.11 


0 


.05 


0.06 


0.08 


0 


.57 


0.05 


40 




0.56 


0 


.54 


0.06 


0. 60 


0 


. 13 


0. 12 



14 s 
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Table 3 (Continued) / 
Factor Loadings Obtained for the On^ 1 , Twp-, and Three- 
Dimensional Simulated I tem Response Data ' ' & 



One Three 
I tern Dimensional Dimensional Dimensional 



II I II III 



41 


c 0\ 


. 16 


0. 


. 14 


0. 


.55 


0. 


.09 


0. 


. 10 


0. 


.55 


42 


0. 


.05 


0. 


. 11 


0. 


. 17 


0. 


.01 


0. 


. 65 


0. 


.10 


43 


0. 


. 62 


0. 


.57 


0" 


. 13 


0. 


.55 


0. 


. 16 


0. 


,11 


44 


0. 


. 16 


0. 


.09 


0. 


.5.2 


0. 


.07. 


0. 


. 12 


0. 


.56 


\ 45 


0. 


.07' 


-0. 


.03 


0. 


. 10 


0. 


.04 


0. 


. 61 


0. 


.01 


'■ 46 


0. 


. 62 


0. 


. 64 


0 , 


.03 


0. 


. 61 


.0. 


.02 


0. 


.09 


47 


0. 


. 11 


0. 


.03 


0. 


.56 


0. 


.07 


"o. 


.03 


0. 


.60 


48 


0. 


.09 


- 0. 


.07 


0. 


.25 


0, 


.05 


0. 


. 62 


0. 


• 16 ■. 


49 


0, 


.60 


0. 


. 60 


0. 


.01 


0. 


. 63 


0. 


.00 


0. 


. 14 


50 


• 0, 


. 19 


0. 


.21 


0. 


. 60 


0. 


.09 


0. 


. 12 


0. 


.5,6 



• • • ■ . ( 

Note . For the two- and three-dimensional data the factor 
loadings shown are from a varimax rotation of the principal 
components solution. 



The correlations between the true a-parameters and the 
factor loadings shown in Table 3 are reported in Table 4. 
As can be seen from Table 4, there, is a strong relationship 
between the discrimination parameters of the M2PL model and 
the factor loadings from the factor analysis solutions. The 
correlation of the a-parameter for, the first- dimension and 
the one-factor solution factor loadings Was 0.98: For the 
two-factor solution the correlation between the a-parameters 
and the factor loadings was 0.98 for both dimensions. For 
the three-factor solution the correlation between the a- 
parameters and the factor loadings was 0.99 for the first' 
dimension, as was the correlation between the a-parameters 
for the second dimension and the factor loadings for the 
third factor. The correlation between. the -a-parameters for 
the third dimension" and the f actor loadings for the second 
factor was also 0.99. As can be seen., the second and third 
factors in the three-subtest solution were reversed in order 
from the true parameters. There is also a strong 
relationship between the dimensionality of the data as 
determined by the eigenvalues and the. dimensionality of the 
parameter vectors. 
*7 



15 



-11- 



These analyses provide strong evidence for the validity 
of the procedure used to generate multidimensional item 
response data. They also provide some evidence that the 
M2PL model actually can be used to model multidimensional 
data. It remains to be seen whether the model is 
appropriate for realistic data. The next issue that must be 
addressed is whether the parameters of the model can be 
accurately estimated. This issue was addressed by the 
simulation data analyses to be reported next. 



Table 4 

Correlations of True Discrimination Parameters 
with the Varivax Rotated Factor Loadings 
. for the Simulated Item Response Data 



Factor Loadings 



True One Two Three 

Parameter Factor Factor Factor 

v 

I I II I II III 



a l 


0. 


98 


— Q-. 


-90- 


—Q-. 


54 — a 


_99 


-0. 


. 51 


-0. 


42 


a 2 


-0. 


. 43 


-0. 


49 


'0. 


. 98 v . -0 


. 47 


-0. 


.49 


0. 


.99 




-0, 


. 51 


-0, 


. 46 


-0, 


.40 -0 


.50 


0. 


. 99 


-0, 


. 54 


a 3 






4 















One -Dimensional Data Table. 5 shows the item parameter 
estimates that were obtained for both models for the one- 
dimensional simulation data. The means and standard 
deviations of the item parameter estimates are also shown in 
Table 5. Note that for the one-dimensional data, parameters 
were estimated . for only one dimension using the M2PL model. 
As can be seen from the table, the estimates for the 
unidimensional simulation data were quite similar for the, 
two models, although*'the mean discrimination parameter 
estimates were somewhat higher for the M2PL model than for 
the 2PL model. The correlation of the. d-parameter estimate 
with the true d-parameter "was .99 for both models. The 
correlation of the a-parameter estimates with the true a- 
parameter was .98 for the 2PL model and .99 for the M2PL 
ntadel. The correlation of the two sets of d-parameter 
estimates was .99, as was the correlation between the two 
sets of a-parameter estimates. 
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Table 5 

Item Parameter Estimates for the 2PL and M2PL Models 
for the One-Dimensional Simulated Item Response Data 

2PL M2PL 

Item ■ : — - — 

d a d a 



1 


' r\ O o 
U . Zj 




r\ o o 
U . oZ 


1 "1 O 
1 . 1Z 


o 
Z 


-{3.1/ 


U . z J 


-u . z-y 


U . J 1_ 


3 


- u . / u 


U . Uo 


- 1 . 1 O 


U . 1 *± 


4 


/*\ o o 

-0.23 


0 . 94 


-U . 41 

> 


• 1 . Z 1 


5 


-0 . 09 


0 . 23 


-U . 1 b 


U . J Z* 


6 


0 . 52 


- 0 . 10 


/"N Q Q 

U . oo 


U . 1 1 


7 


-0.27 


0.96 


-0 . 44 


1.1/ 


8 • 


-0.40 


0.27 


-0 . 68 


0.37 


9 


0 . 16 


0.26 


0.25 


0 . 36 t 


10 


-0.32 


1 . 29 


r 0 . 48 ' 


1 . 42 


11 


/ -0.08 


0 . 13 


-0 . 14 


0.21 


12 


0.52 


0.21 


0 . 87 


0.31 


13 


-0 .-28 


0 . 92 


-0 . 48 


1.18 


14 • 


1 . 14 


0.23 


1.91 


0 . 32 


15 


-0.63 


0 . 08 


-1 . 09 


0.15 


16 


0. 10 


1.20 


0 . 13 


1.36 


'17 


-0. 17 


0 . 29 


-0 . 30 


0 . 44 


18 


0.32 


0 . 22 


0 . 54 


0.31 


19 


0 . 23 


0.99 


0.33 


n o o 

1.23 


20 


0.10 


**0 . 2 1 


. 0.16 . 


on 

0.29 


.21 


x 0.41 


0.04 ■ 


0 : 69 


0 . 06 


22 


0 . 02 


.1.01 


0 . uu 


1 . Z J 


23 , 


• -0?21'^ 


0.22 


-0.36 


"0.31 


24 


-0. 12 


0.2*0 


-0.21 


0.29 


25 


0.24 


0.84 


0. 38 


. 1. 10 


26 


-0. 14 


0.21 


-0;25 


0.34 


27 


-0.16 


0.16, 


-0.27 


0.16 


28 


0.29 


1.13 


0.4*4 


1.34 


29 


-0.22 


0.20 


* -0.38 


0.28, 


30 


-0.26 


0.27 


-0.44 - 


0.38 


31 


0.94 


0.88 


1 . 44 


1 . 10 


'32 


. -0.60 


0.01 


-1.02 


0. 02 


33 


-0.29 . 


0.29 


-0.50 


0.41 


34 


-0.01 


1.32 


-0.07 


1.46 


35 


0.27" 


0.20 


0.45 


0.28 


36 


-0. 19 


- 0.20 


-0.33. 


0.28 


37 


-0.47 


0.91 


-0. 77 


1. 18 


38 


. 0.32 


0. 17 


0.53 


0.26 


39 


.. 0.12' 


0. 12 


0.20 


0. 16 


40 


0.06 . 


■ * 0.94 . 


0.08 


l.'l8 
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Table 5 (Continued) 
Item Parameter Estimates for thev 2PL and M2PL Models 
for the One-Dimensional Simulated Item Response Data 



« ■ • 

2PL M2PL 

I tern i— " — — - 

d a d ' a 



4i . 


0. 


22 


0. 


16 


0. 


.37 


0.26 


42 


-. • -0. 


, 16 


0. 


.08 


-0. 


.28 


0.09 


«>43' 


. '-0. 


, 18 


1. 


.23 


-6. 


.28 . 


1.40 


44 . 


0. 


,03 


0. 


. 18 


0. 


.05 


•0.24 


45 


0. 


,07 


0. 


.08 


0. 


. 12 


0.11 


46 


-0. 


, 11 


1. 


.21 


• -0. 


.22 


1 .38 


47-, 


0. 


. 19 


0. 


. 11 


0. 


.32 


0.20 


48 


-0. 


. 15 • 


0. 


. 10 


-0. 


.26 


. 0.13 


49 


0. 


. 15 


1. 


.07 


0. 


.22 ' 


1.33 


50. 


• . -0. 


. 16 


o. 


.20 


-0, 


.27 


0*30 


Mean 


0. 


.00 


0, 


.47 


-0. 


.02 


0.59 


S.D. 


0. 


.35 


0, 


.43 


0, 


.58 


0.50 



' 9i 



JThe great similarity of est imates obtained for the 

two models was expected, . since in the unidimensional case 
the two models are essentially the same model. Any 
differences that were found between the two sets of 
estimates were pirobaloly the result of differences between 
the two estimation procedures that were used. As indicated 
by the correlations that were obtained, the differences 
found between 'the two- sets of estimates were* minimal, 
involving prima'ri ly a (difference in scale . The variance of 
the estimates for the 2PL model was less than the variance 
of the estimates for the M2PL model. A rescaling of the 
estimates , to place them on the same scale might have 
eliminated most of the differences found between the two 

sets of estimates. 

/ 

1 Descriptive statistics for the ability estimate 
distributions for both models for the one-dimensional, 
simulation data are shown in Table 6. As can be seen, the 
statistics for both models are quite similar to the 
statistics for the true abilities. The one exception is the 
standard deviation of the M2PL ability estimates, which was 
much higher than the standard deviation of the 2PL estimates 
and the true abilities. The correlation of the estimates of 
ability with the true abilities was .91 for the 2PL model, 
and .92 for the M2PL model . The difference between these 




two correlations was .not significant/" The . correlation of 
the ' two sets of ability estimates, was :^9. 

. ■ t 

Table 6 " » ■ 
' Descriptive Statistics for the True and Estimated 
Ability Distributions for -the 2PL and . M2PL Models for 
the One-Dimensional Simulated Item Response Data 



•Statistic . ' 9 ■ True 2PL " . M2PL 



Me an 


0. 


01 


-0. 


01 


0. 


02 


Median 


0. 


.03 


0. 


01 


0. 


06 


• S.D. ' , 


. 1. 


.02 


• 1. 


.03 


L. 


63 


Skewness 


-0. 


.04 


-0. 


. 16 


-0. 


07 


. • Kurtosis 


-0. 


. 18- 


0. 


.24 


-0. 


19' ' 



Two-Dimensional Data Table. 7 shows the- item' parameter 
estimates that were obtained for both models for the two- , 
dimerrsional simulation data. Also shown are the item 
parameter estimate means and standard deviations. The 2PL 
and M2PL item parameter estimate means are r very similar, but 
the M2PL standard deviations are higher (and closer, to the 
true, values) than the 2PL standard deviations. 

Th6 intercorrelation matrix for the true and estimated 
item parameters for the two-dimensional simulation data is 
shown in Table 8. The parameter estimates for the e 
multidimensional version cf the model were quite strongly 
correlated with the true parameters. The correlation for 
the true and estimated d-parameter ff>r the M2PL model was 
.99-. For b<?th a-parameters the correlation was .98. For 
the 2PL mcQel the d-parameter estimate .had a correlation of 
.98 with the true d-parameter, which was not significantly 
different from the correlation for the M2PL model. The two 
sets of d-parameter estimates had a correlation of .99. The 
unidimensional - a-parameter estimates had a correlation of 
.47 with the .first set of true a-parameters and .53 with the 
second set. of true a-parameters. The correlations between 
the unidimensional a-parameter estimates and the 
multidimensional a-parameter estimates was .44 for the first 
set of a-parameter estimates; and .52 for the second se£. 
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Table- 7 ' " * 

•Item Parameter Estimates for the 2PL. and M2PL Models 
for the Two-Dimensional Simulated Item Response Data 



2PL " , M2PL 



item 
• 




d 


• 


a 




d 




1 

- 


JZ — 

* 


i 


0. 


18 


0. 


71 


. o. 


25 


1. 


32 


0. 13 


2 


• -.0. 


12 


0. 




-o, 


31 * 


0. 


08 


1.26 


\" 3 


-0. 


62 




20 


-1. 


08 


0. 


1*2 , 


0.29 


A 4 


-0. 


19 


0. 


68 


-0. 


46 


1. 


12 


0.27 


\ 5 

\ • 


0. 


09 


0. 


69 


0. 


09 


0. 


20 


'1. 14 


' * 6 


0 . 


68 


0 . 


23 


- 1. 


14 


0. 


17 


0.23 


7 


-0. 


07 


0. 


60 


-0. 


25 


1 . 


26 


0. 07 


8 


-0 . 


35 • 


0 . 


74 


-0. 


74 


'0. 


13 


1.30 


9 


Q 


21 


• 0 . 


31 


0. 


32 


0. 


42 


0. 18 


10. 


• -0 . 


14 


0 . 


74 


-0 . 


38 


1 . 


23 


0.21 


11 


• -0 . 


05 


0 . 


69 . 


-0. 


17 


0. 


16 


1. 16 


12 


0 . 


60 ' 


0 . 


15 * 


1 . 


01 


" 0. 


21 


0. 10 


13 


-0 . 


20 


0. 


66 


. -o . 


v 51 


1 . 


21 


0. 13 


' 14 


0 . 


90 


0 . 


58 


1 . 


61 


0 . 


09 


'1 . 10 


15 


-0 . 


55; * 


0 . 


07 


-0 . 


95 


0 . 


, 13 


0. 10 


16 


0 . 


09* 


0 . 


, 74 


0 . 


04 


1 . 


31 


0. 18 


17 


- o . 


07 


0 . 


, 82 


-0. 


20 


0. 


, 18 


1.27 


18 


0 . 


30 


0 . 


,23 


0. 


47 


0, 


,24 


0.21 


19 


0 . 


38 


0 . 


. 86 


0. 


.55 


1 . 


. 30 


0.34 


20 


6 . 


22 


0 . 


.70 


0. 


.32 


0 . 


. 30 


1 . 08 


,. 21 " 


0 . 


, 34 


0 . 


. 20 


0. 


.66 


-0. 


. 04 


"■0.37 


22 • " 


0 . 


. 05 ' 


0 . 


. 64 ■ 


-0. 


.03 


1 , 


. 17 


0.1 4 


23 


-0 


. 08 


*0 , 


.77 


-0, 


.24 


-0, 


.01 


1.49 


24 




,11 


0 , 


. 18 


-0, 


.22 


0 


.28 


0. 11 


25 


0. 


.21 


0 


.66 


0 


.28 


1 


.19 


0.16 


26 


-0, 


. 18 


0 


.89 


-0 


.41 


0 


.34 


1.36 


27 


-0, 


. 14 


0 


.16 ' 


-0 


.25 * 


0 


.10 


0. 17 , 


28 


0, 


.36 


0 


.78 


0 


.51 


1 


.20 


0.32 


29 


-0, 


.20 


0 


.90 


-0 


.45 


" 0 


.26 


1 .42 


30 


-0 


.20 


0 


.28 


, -o 


.35 


0 


.29 


0.25 


31 


0 


.91 


' 0 


. 69 


1 


.57 . 


1 


.28 


0. 13 


32 


-0 


.53 


0 


.60 


-1 


.09 


^0 


.05 


1.25 


33 


-0 


.28 


0 


.25 


-0 


.52 


0 


.37 


0.13 


34 


0 


.07 


0 


.80 


0.03 


1 


.39 


0.21 . 


35 


0 


.23 • 


0 


.82 ' 


■ 0 


.38 


0 


.23 


1.38 


36 


-0 


.20 


0 


.24 


-0 


.36 


0 


.25 


, 0.25 


37 


-0 


.38 


0 


.65 


-0 


.84 


1 


.23 


0.12 


38" 


0 


.34 


0 


.73 


0 


.60 


0 


.13 


1.27 


39 


0 


.19 . 


0 


.09 


0 


.32 


0 


.08 


0.08 


40 


0 


.21 


0 


.64 


.0 


.28 


1 


. 13 


0. 12 
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\ Table 7 (Continued) 

Item Parameter Estimates for the 2PL and M2PL Models 
£6r the Two-Dimensional Simulated." Item Response Data* 



2PL M2PL 

Item '- ; 

d a d a n a 



i 



41 


0.19 ' 


0. 


, 76 


0.28 


0. 


.22 


1. 


, 19 


42 


-0.21 


0. 


.22 


-0.39 . 


0. 


. 16 


0. 


.23 


43 • 


0.02 


0. 


.78 


-0.10 


1. 


.20 


0. 


.28 


44 


0.09 


0. 


.58 


0.10 


0. 


. 10 


1. 


.05 


45 . 


0.06 


0. 


.04 


0.10 


-0. 


.03 


0. 


. 14 


46 


-0.01 


0. 


.72 


-0.18 


1. 


.43 


0. 


.06 


47 


0.24 


0. 


.57 


0.45 


-0. 


.04 


1. 


.20 


48 


-0.22 


0 


.26 


-0.38 


0, 


. 10 


• 0. 


. 40 


49 


0. 16 


0 


. 61 


0.18 


1. 


.27 


0, 


.03 


.50 


-0. 12 


1 


.02 


-0.29 


0 


.41 


1, 


. 38 



Mean -0.04 0.55 ^0.01 0.54 0.55 

S.D. 0.33 0.26 ^0.58 0.53 0.£2 



Table 8 

Intercorrelation Matrix for the True and Estimated Item 
Parameters for the Two -Dimensional Simulated 
Item Response Data 



True 

Variable * 

d a^ 



•True d - 1.00 0.03 0.03 
a x 1.00 -0.45 

' a 2 ' 
2PL d 
a 

M2PL • d 

a i 

' a 2 



2PL - * M2PL 

^ 

d a d a- a 



0. 


, 98 


0. 


01 


0. 


.•99 


0. 


,04 


-0. 


.03" 


0. 


. 12 


0. 


47. 


0. 


.05 


0. 


,98 


-0. 


.48 


0. 


.01 


0. 


53 


0. 


.01 


-0. 


, 50 


0. 


.98 


1. 


.00 


0. 


07 


0. 


.99 


0. 


, 12 


-0, 


.05 






1. 


00 


0. 


.01 


0. 


,44 


0, 


.52 










. 1, 


.00 


0. 


.06 


-0, 


.05 














1-. 


..00 


-0. 


.53 



1.00 
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Table 9 shows the descriptive statistics 'for the ability 
estimate .distributions* obtained for the two models for the 
two-dimensional . simulation data. The statistics for the 
M2PL estimates were; quite similar to the true parameter 
statistics, except that once again the standard deviation of 
the M2PL estimates was inflated. The 2PL statistics were 
much like the statistics for both dimensions of the true 
parameters, except that 'the 2PL estimate distribution was 
significantly leptokurtic .( standard error for N=1000 is 
0.155/ z = 6/823, £ < .01). This is probably due . to an 
increased nonconvergence rate. For . examinees for whom an. 
ability estimate could not be obtained; the estimate was set 
equal to -4.0 or 4.0. . k 

Table 10 shows the interCorrelation matrix for the true 
and Estimated abilities for 'the two-dimensional simulation 
data. The correlations between the true ability parameters 
and the multidimensional estimates were ?91 for both ■ 
dimensions. The unidimensional ability parameter estimates 
had a correlation of .68 with the first set of true ability 
parameters and . 70 with the first set of estimates for the 
M2PL model. The correlation between the ynidimensional 
estimates and the second set of true ability parameters was 
.67, 'While a correlation of .73 was obtained for the 
unidimensional estimates and the second set of ability 
parameter estimates for the multidimensional model. 



Table 9 * 

Descriptive Statistics for the True' and Estimated' 
Ability Distributions for the 2?L and M2PL Models for 
the Twc-Dimensional Simulated Item Response Data 



True 



M2PL 



Statistic 



2PL 



9 



8 



e 



e 



Mean 

Median 

S.D. 



Skewness 
Ku: tosis 



0.02 
0.01 
1.06 
0.15 
1.06 



0.10 
0.08 
1.02 
0.12 
0.08 



L\02 
0.01 
1.02 
0.09 
0. 20 



0.12 
0.16 
1.68 
0.02 
0.00 



0.07 
0.10 
1.71 
0.04 
0. 16 
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Table 10 ^ \ 

Intercorrelation Matrix for the True and Estimated 
Ability .Parameters for the Two-Bimensional 
Simulated Item Response Data 



True M2PL 



'Variable 2PL 



*1 0 2 0 1 9 2 



2PL 




1.00 . 


0 


.•68 


0. 


. 67 


' "0 


. 70. 


0 


.73 


True 


0 i 




1. 


00 


0. 


04 


0. 


91 


0. 


11 
























0 2 








1\ 


00 


' 0. 


,04 


0. 


91 








« / 














M2PL 


0 1 
V 












1 . 


.00 


0. 
1 . 


06 
00 



Three-Dimensional Data Table 11 shoVs the item parameter 
estimates that were obtained for both models for the three- 
dimensional simulation data. The 1 item parameter estimate • 
means and standard deviations are also shown. As can be 
seen, the M2PL estimates once again have much higher 
standard deviations 'than the 2 PL estimate's. The 2PL a-value 
standard deviation is extremely low. The M2PL a-value 
standard deviations* are much closer to. the true values than 
the 2PL value, although the 2PL a-value mean is closer to. 
the true value of 0.70 than the M2PL a-value means. 'Table 
12 shows the intercorrelation matrix for the true and 
estimated item parameters for these data. Once again, the 
estimate's f or ,the M2PL model had high correlations with the 
true, parameters. The d-parameter estimate had "la correlation 
of .99 with the true , d-parameter. The correlation of the 
first a-parameter estimate with the true first, a-parameter 
was .98, as was the case for the second a-parameter. For 
the 'tbird- set. 'of a-parameters the correlation was .99. For 
the unidimensional "version of the model, the correlation 
* between the d-parameter and the estimated d-parameter was x 
.99. Th,e two sets of .d-parameter estimates had a 
correlation of .99. The correlations obtaineci between the 
unidimensional a-parameter estimates . and the three sets of 
true a-parameters were .69, -.26, and -.27, respectively. 
The corresponding correlations between the unidimensional a- 
parameter estimates and the three sets of multidimensional 
a-parameter estimates were .73, -.20, /and -.27. 



23 



Table 11 

Item Parameter Estimates for the 2PL and M2PL Models 
for the Three-Dimensional Simulated Item Response Data 



2PL * • M2PL 
Item : — : — ; 



a l> S 2 . a 3 



1 


0.17 • 


0.70 


0 ?R 




n 

w . 


30 


W . J. ~J 


2 


-0 . 12 


0.53 


-0 . 24 


fr 1 7 

W.J./ 


n 

w . 


■j ^ 


0 14 


3 


-0 i54 
-0 . 29 


0 55 


-1 ?1 


n 

w . 


1 7 
j. / 


1 9 7 

J. . »J 


4 


0 , 66 


-0- ft? 

W a W 


1 1 ? 


o 

w . 


? 9 


0 1^57 




-o m 

\J • \J J. 


0 5ft 


-0 OR 

w . w o 


0 15 

W . J. «J 


1 

J. . 


• .VJ / 


0 19 

W.J.-? 


ft 


- 0 5ft 


0 54 


1 7 7 


W.J./ 


n 

w . 


7 7 


1 59 

J. * JZ 




VJ • X -/ 


o 59 


-0 41 

VJ . TT J. 


1 DP 

J. . w O 


VJ , 


0? 
, VJ o 


0 11 

w . J. J. 


Q 
o 


-0 9ft 


n ft? 

VJ • w *J 


-0 ftl 
• VJ . D J. 


o 97 

VJ • z / 


± , 


7 5 


O 91 

VJ . Z J. 


Q 


n i7 

VJ . J. / 


o ft i 

w . D J. 


o ? 5 


o' 9 ? 

w . Z O 


VJ . 


04 
, vj*± 


1 74 


J. w 


-O 9ft 


0 ft7 

VJ . D / 


-Pi ft9 
vj . uz 


1 7 ft 


vj , 


04 
, VJ ** 


O 9H 

VJ . Z VJ 


J. J. 


■ - n in* 

vj . j. vj 


o 54 

VJ . J *± 


- c O 9 9 • 
VJ . z z 


o i^ 

w . J. J 


± , 


04 

, VJ *± 


O 9 9 
VJ . z z 


J. Z 


o fto 

VJ . OVJ 


o ft 9 

VJ • OZ 


1 IP 


o 71 

VJ . O X 


n- 


H7 

, VJ / 


1 IP 

J. . J. o 


1 7 

»J 




o ft ^ 

Vj . DO 


— o ftp 

~ Vj . Oo 


i np 


u . 


1 7 


O 17 
VJ . Lo 




o q 7 


o ft ft 

vj . D D 


1 Q ft 


n r p 

vj . D O 


1 , 


7 1 


vj . UD • 


i 5 


~ VJ . j *± 


o ft 7 

VJ . CO 


— 1 1 ft 


• «n ?9 

U . o Z . 


n 
\j . 


1 O* 


1 9Zl 
± . Z *i 


*1 ft 


o ift 

VJ . J. O 


o P9 

vj . oz 


O 7 ft 
vj . O D • 


1 9 7 
J. . z / 


VJ , 


9 P 
. z o 


n 9ft 

w . Z D 


'17 


- o in 

Vj . J. Vj 


o ft*7 

VJ . o / 


-O 7 

VJ . v -J 


n 9i 


±. . 


7 A 


O 9ft 
w . Z D 


1 P 


n 7q 

Vj . J 3 


O c: 5 


o pzl 

vj . o*± 


n nft 

vj . vJD 




1 ^ 


1 9ft 
1 .ZD 


1 Q ' 


o 9 p 

Vj . Z O 


o 7D 

VJ . / VJ 


o ^*i 

vj . D J. 


1 9 7 


u , 


hp 

, VJO 


O 70 

VJ . O VJ 


90 

Z. VJ 


o 07 l> 

VJ . VJ / v» 


o 5 5- 

VJ . «J J 


o 19 

VJ • _LZ 


n ?7 

VJ . o / 


j. , 


OO 

. w VJ 


O OQ 

VJ • VJ^? 


9 1 


n 7 9 


n c: ft 


n ft'? 


o r^7 


u , 


7 7 


1 ' 1 Q 


22 


0.05 


0.7Q 


. 0.03 


1.22 


0. 


.05 


0.33 


23 


-0.19 ' 


0. 63 


-0.36 


0.27 


l . 


. 12 


0.27 


24 


0.03 


• 0 . 5*8 


0.05 


0*. 16 


0 


.04- 


1.26 


25 


0.14 


.6.50 


. 0.20 


0.96 


0 


.20 


-0.02 


26 


-0.21- 


0. 66 


-0. 49 


0.23 


l 


.'40 


0.23 


27 


-0.14 


0.52 


-0.31 


0.05 


0 


. 15 


1.27 


28 


0.22 


0.76 


0.43 


1.32 


0 


.31 


0.00 


29 


-0. 14 


0. 60 


-0. 36 


0.26 


l 


.24 


0.21 


30 


-0. 18 


0.63 


-0. 44 


0.27 


0 


.09 


1.27 


31 • 


0.92 


0. 77. 


1.73 


1.21 


0 


. 38 


• 0.00 


32 


-0.46 


0.40 


-0.93 


0.01 


0 


.97 


0.05 


33 


.-0.22 


0. 62 


-0. 48 


0.32 


6 


.24 


1.14 


34 


0.01 


0 . 80" 


-0.02 


1.42 


. 0 


.30 


0.06 


35 


0.22 


0'.58 


0.46 


0.20 


i 


.19 


0.21 


36 


-0. 14 


0".60 


-0.38 


0.28 


0 


. 14 


1.21 


37 


-0.48 


0.70 . 


-1 04 


1.23 


0 


. 19 


0.31 


38 


0.20 


0.46 


0.36 


-0.06 


i 


.03 


0.19 


39 


0.16 


0.52 


0.36 


0.22 


• 0 


.04 


1. 19 


40 


0.07 


0. 84 


0.03 


1.27 


0 


.26 


* 0.31 



24 



-20- * • 

» i • 

Table 11 { Continued) 
Item Parameter -Estimates for the. 2PL and M2PL Models 
for the TThree-Dimen^ional Simulate,d Item Response Data 



2PL M2FL 

v- Itejn ■ — — s : 

d * < a . d " a- a 0 a\ 



41, 


0*14 


0. 


56 


- .6. 


26 


0. 19 


1. 


,07 


0. 


20 


'42 


-0. 14 


0. 


58 


-o. 


,25 


.0.08 


0. 


.•21 


1. 


46 


43 


-0.12 


0. 


77 


. -o. 


30 


1. 10* 


0. 


.23 • 


0. 


35 


44 


0.03 - 


.0. 


59 


' -0. 


,01 


0.13 , 


1. 


. 12 


0. 


36 


45 " 


0.09 


0. 


,46 


0. 


17 Vj 


0.07 


-0. 


.01 


1. 


27 


46 


-0.11 • 


0. 


.65' 


' ' -0. 


.30^ 


•~sa/3o 


. o. 


. 10 


0. 


08 


• 47 


0.21 


"•0. 


.54 


0. 


.41 


0.06 


1*. 


.20 


0. 


12 


'48 


-0.08 •" 


0. 


,65 


-6, 


.22 


0.00 ' 


0, 


.38. 


1. 


40 


49 


0. 19 


o. 


, 72 


- o, 


.31 


1.39 


0 


.25 


-0. 


,01 


50 


-0. 17 


.0. 


.62 


-0. 


.32 


0.12' 


1 


. 15 


0. 


.29 


Mean'' 


-0.16 


Q 


.62 


0 


.00 


0.54 


0 


.51 


0. 


, 53 


S_D. 


0.31 


' 0 


.09 


0 


. 66 


. 0.51 


0 


.48 


0. 


. 53 



■ ■ Table 12 

* Intercorrelati'on Matrix for the True and Estimated 
Item Parameters for the Three-Dimensional Simulated 

Item Response Data ' 



True • * ' 2PL M2PL 



var . 




d 




a l 


a 2 


a 3 




d 




a 




d ' 


a 


1 


a 


2 


, a 3 


True 


d 1. 


.00 


0 


.03 


0.03 


-0.03 


0. 


.99 


0. 


12 


0 


.99 


0. 


07 


0. 


06 


-0.07 




a l 




1 


,00 


-0.45- 


,-0.51 


0. 


,02 


0. 


69 


-0 


.01 


0. 


98 


-0. 


43 


-0.54 




a 2 








1.00 


-0.50 


0. 


.00 


-0. 


26 


0 


.00 


-0. 


47 


0. 


98 


-0.45 




a 3 










•1.00 


-0, 


.02 


-0. 


27 


*0 


.04 


-0. 


48 


-0. 


52 


0.99 


2PL 


d , 












1. 


. 00 


0. 


13 


0 


.99 


0. 


06 


0. 


03 


-0.02 




a 
















1. 


00 


- 0 


.09 


0, 


73 


-0. 


20 


-0.27 


M2PL 


d 




















1 


.00 


0. 


03 


0. 


03 


0.00 




a l 
























1. 


00 


-0. 


43 


-0.52 




a 2 




























*, 1- 


00 


-0.47 




a 3 
































1.00 



25 - 



Table 13 shows th§ descriptive statistics for the ability 
estimate distributions for both models for the three- 
dimensipnal simulation data . /.The 'M2PL statistics are 
sijnilar to, tfie true statistics, except that th,e M2PL 
standard deviations' are higher. % Also, the M2P.L dimension 1 
kurtosis is significant (standard error=0.155, z = 2.860, g 
<-.01), while the true value is not significant. The 2PL ' 
kurtosis is also^signif icant ( z = 5.^706, g < .01), as is 
the 2PL skewness (standard error is 0.077, z = 4.699, p < 
. Ql ) . Again, the skewness and kurtosis of the 'ability 
estimate distributions are probably a~ reflection of 
nonconverg^rtce . 

Table 14 shows the intercorrela'tion matrix for, the true 
and estimated ability parameters for the three-dimensional 
simulation- data". The correlations between the three sets of 
ability parameter estimates f<?r, the M2PL model and the three 
sets of true ability parameters were .'91, .90, and .90/ The 
correlations obtained between the unidimensional ability 
parameter estimates and the three sets of true ability 
parameters were .57, .49, and . 45 .. The corresponding 
correlations fox* the " multidimensional -estimates and the 
unidimensional estimates, \ ;ere -59, .48, and ...48. 



Table 13 

Descriptive Statistics for the Ti;ue and Estimated 
Ability Distributions for the 2PL and M2PL Models for 
the Three-Dimensional Simulated Item Response Data 



• True M2PL 

Statistic 2PL : : • — r 

* e i , 0 2 0 3 -; V . 0 2 G 3 



Mean. 


0. 


.03 


-0. 


.01 


0. 


.00 


0. 


.05 ' 


0*. 


06 


0. 


.02 


. o. 


01 


" Median 


-0. 


.01 


0. 


.02 


0. 


.01 


0. 


.03 


0. 


.01 


0. 


.08 


-0. 


03 


S.D. 


1 . 


.07 


0. 


. 98 


0. 


.99 


1 . 


.02 


1 . 


.47 


1 . 


.59 


•1 . 


64 


Skewness 


0. 


.36 


-0, 


.05 


0. 


.01 


0. 


.07 


0. 


.07 


-0. 


.07 


0. 


08 


Kurtosis 


0. 


.88 


0. 


. 10 


-0, 


. 10 


0. 


.02 


0. 


.44 


0. 


. 19 


-0. 


07 
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Table 14 

Intercorrelation J/Iatrix for the True and Estimated 
Ability Parameters for the Three-Dimensional 
Simulated Item Response Data 



Variable 2PL 



2 
' 9 3 



True M2PL 



6 1 9 2 6 3 6 1 6 2 9 3 



2PL 1.00 0.57 

True ' Q 1 . 00 

9 2 
9 3 

M2PL 8 
8, 



0 


.49 


0 


.45 


0 


. 59 


0 


.48 


0 


.48 




0. 


05 


-0. 


.03 


0. 


,91 


0. 


05 


0. 


.00 




1 . 


00 


-0. 


.02 


0. 


.06 


0. 


.90 


-0. 


.01 








1. 


.00 


0. 


.02 


-0. 


6i_ 


o. 


.90 












1 . 


.00 


0. 


.01 


0. 


.01 
















1. 


.00 


-0. 


.06 




















1 . 


.00 


> 



Overall Performance on Simulation Data The final analysis 
that was performed on the simulation data was an analysis of 
variance performed on the MAD statistics. Table 15 shows , 
the mean MAD statistics that were computed for hoth Models 
for the simulation data. The standard deviations for these 
statistics are also shown. The dimensionality of the data 
and the model used were independe, it- Variables ,. with model as 
a repeated measures factor. The. analysis of variance 
performed on these data yielded the results shown in Table 
16. 



fable. 15 J> 
Descriptive Statistics for MAD Statistics Obtained 
for the Simulation Datasets 



No. of 
Dimensions 


Statistic 


2PL " 


M2PL • 




1 


Mean 


' 0 . 43 


0-41 ) 






. S^D. 


0.06 


0.08 ' 




2 


Mean 


0.43 


0.36 






S.D. 


0 . 04 


0.07 '"' , 




3 


Me an 


0.43 


0.31 






S:D. 


0.02 


0.03 
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Table 16 

Two-Way Analysis of Variance on Mean Absolute Differences 
with Dimensionality of Data and. Model as Independent Measures 
with Repeated Measures over Model 



Source - SS df MS F p 



Dimensionality 


0. 


136 


2 


0.^068 


13. 


390 


"0. 


000 


Error 


0. 


749 


147 


0.005 










Model 


0. 


390 


1 


0.390 


1223 . 


040 


0. 


.000 


Model x Dim. 


0. 


098 


2 


0..049 


154. 


220 


0. 


.000 


Error 


0. 


047 


147 


0.000 











As can be seen, all of the effects were found to be 
significant. The test^for the significance of the 
dimensionality effect "Yielded an F = 13.39, p < .01. 
Analysis of the cell means indicates' £hat the models yielded 
lower mean MAD statistics as the dimensionality of the data 
increased. The'pterS.t for -the significance of the 
dimensionality JbySnodel interaction yielded an F = 154.22, p 
< .01. A look"at"the cell means, reported at the bottom of 
Table 15 , reveals that the mean MAD statistics decreased at 
a much faster rate for the M2PL model .than for the.2PL 
model. As the dimensionality of the data increased, then, 
the advantage gained by use of the multidimensional model 
increased. 

The test for the model effect yielded an F = 1223.04, p < 
.01, indicating that across the three sets of response data 
the M2PL model yielded significantly lower mean MAD 
statistics. Paired t - tests were performed on these data 
to compare the mean MAD statistics yielded by the, two models 
for each level of dimensionality. These t - tests yielded a 
t = 10.64, p < .01 for the unidimensional data, ,t = 14.36, p 
~< .01 for the two-dimensional data, and t = 46.30, p < .01 
for the three-dimensional data. ^Regardless of the 
dimensionality of the data, the M2PL model fit the data' 
better than the 2PL model. 

Real Data Analyses 

Factor Analyseg_ ; T he results of the principal components 
— arra±y3Xs~^b t phi coe f f ic i ent s for the three real data 
datasets are summarized in Table 17. For the two- and 
three-subtest data the factor loadings shown are from a 
varimax rotation of the principal components_solution . The 
first two eigenvalues from the principal components analysis 
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of the one-subtest data are 4.22 and 1.78. The first three 
eigenvalues from the principal components analysis of the 
two-subtest data are 3.78, 2.27, and 1.24. For the three- 
subtest data the first four eigenvalues are 3.84, 2.72, 
1.64, and 1.29. 



Table 17 

Factor Loadings Obtained for the One-, Two-, 'and Three- 
Subtest Real Item Response Data 

One Two Three 

Item Factor Factor Factor 





I 


I • 


1 1 


. I 




1 1 


III 


1 


0.16- 


0.5? 


-0.03 


0 . 


56 


0. 03 


-0.07 


2 


0. 15 


0. 59 


0.04 


0. 


60 


0 . 08 


0.01 


3 


0. 16 


0.37 


0.12 


0. 


45 


0. 17 


0.05 


4 


0.36 


0.46 


0. 16 


0. 


40 


0 . 06 


0 . 00 


5 


0.25 


0 . 33 


0. 10 


0. 


58 


0.05 


0 . 06 


6 


0. 13 


0.36 


0. 03 


0. 


48 


0.05 


0.00 


7 


0.20 


0.42 


"0.02 




52 


0. 10 


0 . 07 


8 - 


0.24 


0.56 


0.02 


f 


48 


-0.02 


-0.01 


9 


0.28 


• 0.32 


0.08 




%■ 


-0.02 


0.06 


10 


0.25 


0.48 


0.01 






■2-0.02 


0.03 


11 


0.52 


0.53 


0.08 


0. 


07 


0.46 


0.05 


12 ' 


0.32 


•0.47 


-0.06 


. 0. 


01 


0.36 


0.07 


13 


0.29 


0.26 


0.22 


-0. 


10 


0.30 


0.10 


14 


0.55 


• 0.61 


-0.00 


0. 


00 


0.34 


-0.03 


15 


0.39 


0. 64 


-0.03 


-0. 


01 


0. 14 


0.80 


16 


0.34 


0. ll 


0.47 


0. 


11 


0.21 


0.26 


17 


0.22 


0.*03 


0.38 


0. 


03 


0.52 


0. 14 


18 


0.49 


0.06 


0.25 


0. 


07 


0.36 


0.09 


19" 


0.36 


0.01 


0.28 


-0. 


03 


0.50 


. 0.05 


20 


0.37 


0.09 


0.37 *~ 


. 0. 


07 


0.35 


■0.05 


21 


0.40 


0.02 


0.35 . 


0. 


19 


0.43 


• 0.00' 


22 


0.51 


0.00 


0.43 


0. 


06 


0.42 


0. 11 


23 


0.35 


0. 12 


0.34 


0. 


07 
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0.05 


24 


0.33 


0.06 


0.61 


-0. 


07 


"0.43 


0. 10 


25 


0.46 


0. 15 


0.36 


0. 


,04 


0.46 


-0.04 


26 


0.50 


0.09 


0.24 


-0. 


,00 


0. 10 


0.78 


27 


0.40 


0.P7 


0.46 


0. 


. 15 


0.39 


0. 19 


28 


0.34 


0.05 


0.27 . 


0. 


.08 


0.23 


0.29 


29 


0754. 


0.02 


0.49 


0. 


.04 


0.44 


0.01 


30 


0.57 


0.10 


0.33 


-0. 


.01 


0.08 


0:<83 



Note. For the two- and three-subtest data loadings are from 
a varimax rotated principal components solution. 
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As can be seen from the results of the factor analyses, 
the one-subtest data do at least approximate 

unidimensionality, even though some of the items did appear 
to load on specific factors. The first principal component 
is not a particularly large one, but it does seem to be 
dominant, as reflected by the smallness of the second 
"component. The two-subtest data do not approximate 
unidimensionality. Rather, they seem to have two main 
components. This is a reasonable reflection of the subtest 
structure of these data. The factor loadings shown in Table 
17 for the two-subtest data 1 give an accurate picture of the 
subtest structure of sthd data, with the first 15 items 
having higher loadings on the first factor and the last 15 
items having higher loadings on the second factor. The 
first 15 items were taken from the spelling test, and the 
last 15 were taken from the grammar test. 

The three-subtest data results are not as clear. The 
first ten items were from the spelling test, the second ten 
were from the grammar test, . and the last ten were from the 
punctuation test. From the results of the factor analysis 
it can be seen that the spelling items loaded on the first 
factor, and all of the second ten items exoept Item 15 
loaded on the second factor. However, the last ten items, 
which were the punctuation items, tended to load on the 
second factor with the grammar items. This tendency is 
reflected in tlte smallness of the' third eigenvalue from the 
principal components analysis. Only items 15, 26 and 30 had 
high loadings on the third factor. Thus, while the 
construction of the one- and two-subtest tests was 
successful, less ' success was -achieved in* constructing a 
three-subtest test . . ^ — - 

One-Subtest Data The item parameter estimates that were 
obtained for the one-subtest data for both the 2PL and the 
M2PL models are shown in Table 18, alortg with their means 
and standard deviations. The two sets of d-values had 
similar standard deviations, but th£ 2PL model mean d-.value 
was somewhat higher. The M2PL a-values had a higher mean 
and standard deviation than the 2PL a-values. Table 19 
shows the intercorrelation matrix for the estimated , item 
parameters for these data. The correlation of the two sets 
of d-parameters estimates was .93, and the correlation of 
j the two sets of a-parameter estimates was . 92 . 
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Table 18 

Item Parameter Estimates for the 2PL and M2PL 
Models for the One-Subtest Real Item Response Data 



2PL M2PL 

Item ; : 

d . a d a 



1 


T 71 
1 . / 1 


U. JO 


"o "1 A 

Z . _Lf± 


n ftp 

U . DO 


2- 


U . ±z 


u . zb 


_ p, r\/\ 


vj . z z 


3 


p o T 

2 . 10 


n oq 
U . Zo 


O 9/1 
U .. Z ft 


n 9 ^ 


4 


U . o / 


1 . Ob 


-L • Uj 


5 


..0.58 


p r r 

U . bb 


C\ AO 


H 9 Q 

u . z y 


6 


p r- n 

U . b 1 




U . jD 


VJ . O VJ 


7 


-0 . 10 


U.J/ 


-U . b b 


U. jo 


8 < 


; 0.23 


0.51 


p pi o 


O 9 /L 
VJ . Z*± 


9 


2 . 09 


0. 69 


z . lb 


u . y i 


10 


0 . 69 


0 . 54 


p AO 


VJ . f±*± 


11 


3 . 49 


1 . 40 


Z . / 1 


l . / b 


12 


1.03 


0.56 


0.77 


0. 79 


13 


0 . 08 


0.47 


- u . by 


n n a. 


14 


2 . 14 


1.26 


1.37 


2 .04 


15 


1. 04 


0.70 


0.46 


. 1.01 


16 


0..54 


0. 59 


-0. 12 


0.90 


17 


0.02 


0.30 


-0.46 


0.51- 


18 


1.03 


1.09 


0.16 


■ 1.49' 


19 


1.16 


• 0.69 


0.69 


1.01 


20 


1 . 46 


0.71 


1.12 


1 . 01 


21 


1.66 


0.70 


1.28 


1.24 


22 


2:24 


1.14 


1.43 


1. 41 


23 


0. 72 


0.56 


0.09 


1.01 


24 


1.28 


0. 67 


1.02 


0.80 


25 


2.30 


1.07 


1.69 


1. 35 


26 


1.40 


0.97 , 


0.48 


1. 32 


27 


2 . 78 


0.90 


2.80 


1 . 42 


28 


-0.08 


0. 66 


-1.08 


0. 94 


29 


2.70 


1.26 


1.83 


1. 65. 


•30 


2 . 56 


1.45 


1.44 


- 1.69 


Mean 


1.26 


0.73 


0.81 


0. 96 


S.D. 


0-98 


0.34 


0.99 


0.. 50 



Table 20 shows the descriptive statistics for the ability* 
estimate distributions for both models for the one-subtest 
data. The two distributions, appear to be quite similar. 
The two sets of ability estimates had a correlation of .86. 
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Table 19 

Intercorrelation Matrix for the Estimated Item 
Parameters for the 2PL and M2PL Models for the. 
One-Subtest Real Item Response Data 



2 PL 



Variable 



M2PL 



2PL d 
a 

M2PL d 
a 



1.00 



0.82 
1.0C 



0.93 
0.57 
1.00 



0.80 
0.92 
0.56 
1.00 



. ■ . ^ 

Table jtO 

Descriptive Statistics for the Ability Estimate 
Distributions for the 2 PL /and M2PL Models for the 
One-Subtest Real Item Response Data 



Statistic' ^ 




2PL 


,M2PL 


9 


Mean 
Median '. 
S.-D. 

Skegness 
Kurtosis 




">''0'.M 

-0.08 
1.1-8 
0.&2 
1.89 

1 • 


0. 11 
-0. 13 

1. 19 
1.06 
2 .04 




















* 





Two-Subtest v Data ^Table 21 shows the item pa 
estimates that c ^ ere obtained "£or the two model 
subtest real da^ba, along with their means and 
deviations. The\wo sets of d-values are simi 
the 2PL mean is sli^b±ly higher and its standa 
little lower. The 2PLH-value c mean was simila 
for the dimension 1 a-valUes for the M2PL mode 
standard deviation was moreNlike the standard 
dimension 2 of the M2PL models. Dimension 2 of 
model h'ad a lower mean and standard deviation 
1. ■ • , • 



rameter 

s for the two- 
standard 
lar, though 
rd deviation a 
r to the mean 
1 , while the 
deviation for 

the M2PL 
than dimension 



ation matrix for the two 
for these data. ' The 



Table 22 shows the intercorre 
sets of item parameter estimates 
correlation of "the two sets of d- parameter estimates' was 
.96. The correlation of the uniqimensional a-parameter 
estimates with the multidimensional a-parameter estimates 
was .87 for the first dimension and -.40 for the second 
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dimension. 

<v> • 

Table 21 

Item Parameter Estimates - for the 2PL and M2PL Models, 
for the Two-Subtest Real Item Response Data 
* * 

2PL M2PL 

Item ; 

d a d a^ a^ 



1 


3 49 




4? 


3 17 


T 4? 


0 1 2 - " 


9 


9 




J. D 




1 ? ft 


VJ . ZiU 


sj 


n qq 

\J . ZJ y 


n 




0 ftfi 
u . uu 


0 7 Q 


0 9ft 


£L 


Ci RQ< ' 
VJ . O y 


n 

* \j * 


ft"} 


w . Z Z 




D 90 


c 
D 


± - uo 




D *± 


■ n Q7 

VJ * .7 / 


n ft ft 


0 17 


CL 

D 


1 . JO 




c c 
D D 


J. . *±VJ 


VJ * / o 


D 1ft 

U . ID 


1 


1 . du 


u . 


UJ 


1. J? 


n q 7 

„VJ . .7 / 


Ci 91 


8 


2.17 


1 . 


08 


1.80 




0. 17 


Q 

:7 


u • o / 


u . 


d.9 


VJ . *±o 


O ft R 


0 17 


10 • 


2 . 13 


0. 


91 


2.05 


1.00 


, 0.16 


11 


1.37 


0. 


93 


0.80 


1.11 


"0.14 


12 


2.78 


0. 


92 


- 3.22 


1 . 13 


-0.08 


13 


-0.07 


Ho. 


48 


-0.94 


0.69 


•0.4l" 


14 


2.72 


l. 


28 


2.27 


1 .39 


0.23 


">L5 


2 .32 


. l. 


, 13 


2.04 


1.57 


0.01 


16 


1.15 


0. 


79 


1.12 


0.47 . 


0 . 89- 


17 


-1.20 


0. 


, 50 


-2.68 


0.33' 


0.85 


18 


0.22 


o. 


.3.1 


-0.06 


0.20 


0.41 


19 


.1.09 


0. 


.32 


1.44 


0.02 


0.57 


20 


0.32 


0. 


. 28 


0.33 


-0.22 


0.51 


21 


1.35 


,Q. 


.49 


1.58 


0.10 


0-. 73 


22 


0.18 


0, 


.42 


-0.30 


0.09 


0.78 . 


23 


0.76 


0. 


. 52 


0.50 


0.31 


0J55 


24 


-0.07 


0 


.87 


-0.85 


0.26 


l.'2S ; 


25 


-0.05 


0 


. 18 


-0.30 


-0.26 


0.61 


26 


0.96 


0 


. 43 


1.04 


0,22 


0.32 


27. 


-0.02 


0 


. 53 


-0.79 


0.25 


0.73 


28 


0.53 


0 


. 30 


0.40 


0.20 


0.47 


29 ' 


-0.65 


0 


. 60 


-1.66 


0.07 


0.80 


30 


1.13 


. 0 


. 54 


1.11 


0.26 


0.55 


Mean 


1.04 


•0 


. 67 


0.73 


0. 60 


0.42 


S.D. 


1.06 


. 0 


.32 


1.32 


0.52 


0.31 
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Table^22 

Intercorrelation Matrix for Estimated Item 
Parameters for the 2PL and M2PT. Models for thej 
Two-Subtest' Real Item Response Data 



Variable 



B l 



2PL M2PL 



a l a 2 



2PL d ' 1.00 0.74 0.96 0.77 -0.70 

a 1.00 .P. 55 0.87 -0.40 

M2PL d 1.00 0.61 -0.67 



1.00 -0.72 

a„ 4 1. 00 



Table 23. shows the ability estimate distribution 
descriptive statistics for both models for the two-subtest 
real data. The 2PL distribution is similar to the 
distribution of.M2PL ability estimates. on dimension 2, 
although it was less leptokurtic. The dimension 1 M2PL 
estimates had a greater standard deviation, were more 
skewed, and were less leptokurtic than the dimension 2 or 
2PL estimates. 

Table 24 shows the intercorrelation matrix for the 
estimated ability parameters for the two-subtest real data. 
The correlation of the 2PL ability parameter estimates with 
the M2PL. ability parameter estimates was .53 for the first 
dimension and . 67 for the second dimension. 



Table 23 

Descriptive Statistics for Ability Estimate 
Distributions for the 2PL and M2PL Models for the 
Two-Subtest vReal Item Response Data 



M2PL 

"Statistic • 2PL — 



6 1 8 2 



Mean 


0. 


05 


0. 


.40 


0. 


. 08 


Median 


-0. 


,08 


0. 


..10 


0. 


.02 


S.D. 


1. 


10 


1 . 


.60 


1. 


.21 


Skewness 


0. 


. 58 


0. 


.80 


0; 


.50 


Kurtosi s 

-■t 


1. 


. 09 • 


0. 


.67 


1. 


.83 
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Table 24 

Intercorrelation Matrix for the True and Estimated 
Ability Parameters for the Two-Subtest Real 
Item Response Data 

M2PL 

Variable 2PL : : 

• 6 1 6 2 

2PL 1.00 f . 0.53 . 0.67 

* M2PL 9 1 ' 1 . 00 -0. 12 

• 9 0 1.00* 



Three-Subtest Data Table 25 shows the" unidiijiensional and 
multidimensional item parameter estimates that were obtained 
for the three-subtest Teal item response data, along-with 
their means and standard deviations. The 2PL d-values had, a 
higher moan and a lower standard deviation than the M2PL' d- 
values. .The 2PL a-values had a- higher mean and a lower 
standard deviation than dimensions 1 and 3 of the M2PL 
model. The 2PL a-vaiue standard deviation was about the 
same as the M2PL dimensiojrt 2 a-value standard deviation. 
Table 26 shows the intercorrelation matrix for the two sets 
of item parameter estimates, for these data. The two sets of 
d-parameter estimates had a correlation of .99. The 
correlation. between the unidimensional a-parameter estimai^s 
and. the multidimensional a-parameter estimates was .70 for 
the first dimension , -.38 for the second dimension, and .04 
for the third. . 

Table 27 shows the descriptive statistics for the ability 
estiniate distributions for both models for the three-subtest 
real data. The 2PL distribution is similar to the dimension 
2 distribution for the M2PL model, although the 2PL standard 
deviation is sorrftlwhat smaller. The dim&nsion 1 and 3 M2PI 
distributions have much higher standard deviations apd are 
less skewed and leptokurtic. Iti addition, the dimension 1 
mean is much higher. 
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• Table 25 

Item Parameter -Estimates for the 2PL and M2PL Models 
for the Three-Subtest Real Item Response Data 

: — 4 



2PL 



'M2PL 



I tern 






















Q 




J. 

Si 




a 

1 


a 

2 


3 


1 




Uo 


1 . 


9 1 
z -L 


7 9R 


1 1 V 


0 4? 


-0 . 09 


z 


1 . 


H Q 

/ o 


u . 


QQ 

oo 


i £»n 


- ± . -L O 




-0 05 


3 


U . 


H Q 

'? 


u . 




U . DZ 


VJ . -7 37 






4 _ 


1 . 


A Q 


U . 


'A Q 


± . / _L 


VJ . OVJ 




0 07 


5 


Z . 


Uz 


» U . 


y 3 


, J. . O / 


i in 

•_L . _L JL 


VJ . Z J 


0 '11 


6 


1 . 


y y 


U . 


7 Q 

/ y 


Z . _L D 


VJ . O / 


n 9i 


0 0? 


i 


1 . 


22 


U . 


7 T 

/ 1 


Q 9 

u . yz 


O Q£» 
„U . 3? O 


n i A 


VJ . VJ 37 


•8 


2 . 


61 


u . 




7 9 7 
J . Z / 


1 O 7 


n no* 


* T VJ . VJ D 


9 


2 . 


5 1 


1 . 


T A 
1ft 


9 A A 


1 7 7 


VJ . Z VJ 


0 ? ? 

VJ . 


10 


2 . 


05 


0 . 


O Q 

8y 


9 T a 

z . lb 


1 A 9 
1 - *±Z 


n 19. 

( VJ ±z 


***d 17 
1 VJ . _L O 


11 


1 . 


11 


0 . 


/ 5 


1 . U / 


U . O ft 


n q r 


n ? a 

VJ . Z *± 


12 


-1 . 


21 


0 . 


41 


9 

-Z . DJ 


ii 


u . DO 


D 7 R 

U . J J 


13 


0 . 


,31 


o . 


28 


U . Z / 


r\ 9i 
— U . Z 1 


n 7P 
u . o O 


n 9Q 

VJ . Z 37 


' 14 


1 . 


. 32 


0 . 


a -el 

. 46 


1 . bU 


U . Uo 


O A7 


VJ . VJO 


15 


0. 


,19 . 


0. 


■ 76 


-0.70 


0.01 


0.51 


2/00 


16 


o . 




u . 


. b j 


u . *±y. 


n 9Q 


VJ . *±VJ 


0 74 


17 


-0. 


. 10 


0. 


. 69 


-1.03 


0 . 14 ' 


0.79 


0 :.3'2 


18 


-0. 


.05 


0. 


.40 


-0. 68 


0. 19 


0.48 


0.20 


19 . 


-0, 


.67 • 


0. 


. 53 


-1.6*4 ' 


-0.13 


0.74 


0.16 


20 


1. 


. 13 


0. 


.57 


1.06 


0. 19 


0. 64 


0 . 10 


21 


■ 0, 


. 14 


0 


. 59 


-0.62 


0.46 


0. 61 


0.06 


22 


0. 


.29 


0 


.53 


-0.08 


0.21 


0.80 


0.27 


23 


1 


. 63 


0 


. 63 


1.78 • 


0.26 


0.56 


■0.22 . 


24 


0 


. 01 


• 0 


.41 


. .-0.45 


-0. 15 


0."60 


. 0. 18 


25 


1 


.38 


0 


.66 


1.38, 


0. 10 


0.83 


0.02 • 


26 


0 


.40 


0 


. 70 


-0.03 


-0.02 


0.33 


1.66 


27 


0 


.73 


0 


. 77 


0.42 


0.44. 


0. 69 


." 0.33 


28 


0 


. 67 


0 


.53 


0.41 


0.14 


0.34 


0.42 


29 


0 


.86 


0 


.56 


0.61 


0. 17 


0.79 


0. 17 


30 


0 


.63 


0 


. 80 . 


0.46 


-0*. 02 


0.29 


2.05 


Mean 


' 0 


.97 


0 


. 67 


0.72 


0.4'5 


0,48 


0..33 


S.D. 


0 


.98 


0 


.21 


1.3 7 


0. 49 


0.24 


0.55 
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* Table 26 

Intercorrelation Matrix for the Estimated Item 
• Parameters for the 2PL and M2PL Models for the 
Three-Subtest Real Item Response Data 



Variable 



4- 



l 

l 3 



2PL M2PL 



>a l a 2 ' a 3 



2PL d i:00 0.73 0.99 0.76 -rO/52 -0.32 

a 1.00 0.62 ^ 0.70* -0.38 0.04 

M2PL d • " " "M.00 0.69 -0.50 -0.33 

' • 1.00 -0.64 -0.42 



a 0 ' ^ V ' 1.00 -0.05 

1.00 



Table 28 shows the intercorrelation matrix for the 
estimated ability parameters for the t'hree-subtest real 
data. The unidimensional ability parameter estimates had a 
correlation of .33 with the first dimension of the 
multidimensional ability parameter estimates, .53 with the 
second dimension, and .47 wi^h . the third . 

1 * & Table, 27 
Descriptive Statistics for the Ability Estimate 
Distributions for the 2PL and M2PL Models for the 
Threfe- Subtest Real Response^ Data 



M2PL 



Statistic • 2PL 



9 2 



Mean 


0. 


,12 • 




0. 


,61 


0. 


31 


0. 


,24 


Median 


-0. 


.04 




0. 


26 


0. 


09 


0. 


,09 


S.D. 


i. 


. 18 




1 . 


.79 


1 . 


48 


1. 


.98 


Skewness 


0. 


.86 




0. 


.64 


0. 


90 


0. 


.10 


Kurtosis 


l. 


.12 




-0. 


.07 


1 . 


03 


0, 


.32 



* " Table 28 - * 

Intercorrelation Matrix for the True,and Estimated 
Ability Parameters for the Two-Subtest Real 
Item Response Data ' 
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Variable ^2PL 



M2PL 



2PL 
M2PL 



1 .00 



0.33 0.53' 0.47 
1.00 -0.11 0.11 

1.00 -0.25 

1.00 



Overall Performance on Real D ata Table 29 shows the means 
and standard .deviations of the MAD statistics that were 
computed for the real data. Table 30 summarizes a two-way 
analysis of variance that was performed on the MAD 
statistics computed for the three sets of real data. The 
number .of subtests and the model used were the independent 
variables. Model was treated as a repeated measures 
variable. , ' 

Table 29 

Descriptive Statistics for MAD Statistics Obtained 
for the Real Datasets 



No. of 

Statistic 2PL M2PL 

Subtests „ 



1 


Mean 


0, 


.-30 


0. 


.34 


B 




S.D. 


o: 


.14 


0. 


, 12 




2 


Mean 


0*. 


.31 


0. 


.29 


I' 




S.D. 


. 0. 


. 12 


. 0. 


,11 


I 


3. 


Mean 


0. 


.31 


0. 


.28 






S.D. 


0 


. 12 


0. 


, 11 
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Table 30 

Two-Way "Analysis of' Variance on Mean Absolute Differences 
with Number of Subtests and Model as Independent Measures 
with Repeated Measures over Model 



Source , 




SS 


df 


MS 


F 


P 


No. of Subtests 


0. 


.036 


2 


0..018 


0. 670 


0.516 


Error 


2. 


. 355 


87 


0.-027 






Model 


0. 


.007 


1 


0.007 


7. 730' 


0.007 


Model x Subtests 


0 


.066 


2 


0..033 


37.250 


0.000 


Error 


0 


. 077 


87 • 


0.001 







As can be seen in Table 30 , the number of subtests effect 
was not significant. However, the model effect was 
significant ( F = 7.73, p <. .01), as was the model by number 
of subtests interaction( F = 37.25, g < .01). Paired t - 
tests performed for each level of subtest structure yielded 
a t = 5.J.0,-£ < .0-1 for the one-subtest" data, t = 3.62, < 
.01 for the two-subtest data, and t = 5'. 96, 2 < .01 -for the 
threfe- subtest data. ■ It can be seen from the cell means 
shawn in Table*o29 that the 2PL model yielded a'iower mean 
.MAD statistic for the one-subtest data, While the M2PL model 
' yielded lower mean MAD statistics for the two- and three- 

subtest data. Over all datasets, the M2PL model* - 
"outperformed the 2PL model, although the estimation 
- procedure used for the ,2PL. model seemed to perform better on 
the real data than did the estimation procedure for the M2PL 
model, as was reflected in the results of the analyses of 
the one-subtest data. The advantage of using the M2PL model 
became evident when two-subtest data were analyzed, and the 
-advantage increased as the number of subtests increased. 



Discussion 



The purpose of this study was to investigate the^ 
feasibility of a multidimensional latent trait model'. 
Several research questions were of interest. First, it was 
necessary to determine whether the parameters of the M2PL 
model could be accurately estimated. No model is useful if 
the parameters of the model cannot be accurately estimated. 

A second research question addressed by this study is 
whether -a multidimensional latent trait model more 
adequately models multidimensional item response data than 
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does a unidimensional model. If it does not, then it is not 
useful even if the parameters of the model can be estimated. 

This research was divided into two parts: one part based 
on simulation data, and one part based on real data. The 
simulation part of the research was designed to determine, 
whether the M2PL model could be used to model 
multidimensional item response data, whether the model 
parameters could be successfully estimated, and whether the 
model would fit multidimensional simulation data more 
adequately than the unidimensional version of the model. 
The real data part of the study was designed to determine 
.whether the M2PL model would yield satisfactory results when 
applied., to real data. The results of the simulation part of 
the study will be discussed first, and then a discussion of 
the real 'data part of the study will be presented. 

Simulation Data . Analyses 

Facto r Analysis Results The results of the factor 
'analyses of the simulation data indicated that the attempt 
to. generate multidimensional item response data was 
successful. There was a clear correspondence between the 
number of dimensions of the model parameters, used to'* 
generate the data and the dimensionality of the data as 
indicated by the factor analyses. In addition, there was a 
clear relationship between the item discrimination 
parameters and the factor loadings obtained from the 
principal components analysis of phi coefficients. Thus, 
not only was the generation of the data successful, but 
evidence was obtained for the validity of the M2PL model. 

One-Dimensional D^ta In the one-dimensional case the 2PL 
and M2PL models were. essentially the same model. The M2PL 
model was just a reformulation of the 2PL model. Therefore., 
any differences found between the two models in the 
unidimensional case are probably due to differences in the 
estimation procedures used for the two models. 

Even if the two estimation procedures yielded equal 
quality estimates, some differences might appear in the mean 
absolute differences for the two models. The M2PL procedure 
tends to yield estimates having greater variance than the 
estimates yielded by the 2PL procedure. " More extreme 
estimates tend to yield predicted probabilities of responses 
that are more extreme (closer to 0 or 1), thus reducing the 
deviations between the item responses and predicted 
probabilities. It is unclear at this point whether there 
are inherent advantages in using one estimation procedure or 
th§ other. "Any differences that do occur due to differences 
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in the estimation procedures will be evident in the results 
of the analyses of the unidimensional data, since for this 
case the two models are the same. Any dif ferences . found 
between the two models fpr the,, unidimensional case will 
serve as a baseline f or* evaluating the results of the 
analyses of multidimensional data . 

*~ ' \ 

The results of the analyses of the one w dimensional 
simulation data indicate that the the M2PL model performed 
slightly better than the 2PL model. The correlations of the 
true and estimated ^parameters were no*t significantly 
different for the two models, but the analyses of the mean 
absolute differences computed for the two models indicated 
that the goodness of fit of the M2PL model- to the data was 
significantly better than the fit for the 2PL irtodel. 
Although the parameter estimates were quite similar for the 
twq^models, the M2PL model estimation procedure ^ yielded ' 
better fit to the data than the unidimensional estimation 
procedure did . The differences in mean absolute differences 
for^.the one-dimensional data serves a-£^a baseline for 
evaluating the »resylts of the & analyses of, the two- and D 
three-dimensional data. If there is any advantage to using 
a multidimensional model, the difference between the. mean 
absolute differences for the two models .must be gjpeater for 
the two- and three-dimensional data than for" the 
unidimensional data . 

Two-Dimensional Data The results of the analyses of the 
two-dimensional simulation data indicate that there is some 
advantage to- using the M2PL model. The correlations of the 
estimated and true parameters fen? the M2PL model indicate 
that for two-dimensional simulation data the parameters of 
the model can be accurately estimated. The mean absolute 
differences analyses indicate that the M2PL model yields 
significantly fetter goodness of fit to the two-dimensional 
data tucm the unidimensional model. It is unclear how much 
of the difference between the two models is due to 
differences in the estimation procedures, but the results of 
the analyses of the unidimensional data indicate that at 
least part of the difference is due' to dif f erences in the, 
estimation procedures for the two. models. 

Three -Dimensional Data As was the -case for the two- 
dimensional data , for the three-dimensional data the M2PL 
model yielded parameter estimates that were hi-ghly 
correlated with the true parameters. From these results it 
appears that even with higher dimensionality the parameters 
.*bf the M2PL moael can be accurately estimated. The mean 
absolute differences analyses indicate that the M2PL model 
yields better fit to the three-dimensional data than the 2PL 
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modiel. Again, at least part of the difference between the 
two models is due to dif fierences in the estimation 
procedures. 

Overall Performance on Simulation Data It is clear that 
using the M2PL model for the multidimensional simulation 
data yields much better fit of the model to the data than 
could be obtained using the unidimensional model. For the 
unidimensional case there is very, little difference between 
the two models, but as the dimensionality of the data „ . 

increases so do the advantages of using the M2PL model 
model. Of course, these conclusions are based on the 
analysis of simulation data generated to fit the M2PL model. 
Any final conclusions regarding the value of using the M2PL 
model must be based not only on the results of simulation 
data analyses , but, also on the results of real data 
analyses. 

Real Data Analyses ' ' * n 

' Factor Analysis Results The results of the factor 
analyses performed on the real data 'indicate that the 
attempt to construct realistic multidimensional data was 
successful. The ' one-subtest data had one dominant factor, 
and the two-subtest data had two roughly equal factors. The 
three-subtest data had two large factors and a third smaller 
factor. Thus, with the exception of the smallness of the 
third factor of the three-subtest data, the factor structure 
of the real data closely paralleled the subtest structure of 
the data. 

One-Subtest Data For the one-subtest real data the fit of 
the 2PL model to the data was better than the fit of the 
M2PL model. The estimation procedure used for the 2PL model 
appears to be more robust tp violations of the assumptions 
of the model that are f<=>und in real data than is the case 
^►for the estimation procedure used for the M2PL model. 

r 

Two-Subtest Data The results of the analyses of the two- 
subtest data indicate that the fit of the M2PL model to 
these data was significantly better than the fit of the 2PL 
model. Thus, the advantages of using a multidimensional 
model with multidimensional real data are sufficient to r 
overcome any advantage the 2PL model may have had on the 
basis of the estimation procedures. 

Thre e-Subtest Data The results of the analyses of the 
three-subtest data were consistent with the results of the 
two-subtest data analyses. The fit of the M2PL model to the ■ 
three-subtest data was better than the fit of the 2PL model 
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to the data. This is consistent with the results of the 
simulation data analyses. * 

Overall Performance on Real Data The analyses of the one- 
subtest data indicate that the estimation procedure used for 
the 2PL model may be somewhat better than the procedure used 
for the M2PL model when applied to real data. However, 
whatever disadvantage the M2PL model may have had due to the 
estimation procedure was overcome when the models were 
applied to multidimensional data. As the number of subtests 
in the real data increased, the difference in the fit of the 
two models to the data also increased. 

• Summary and Conclusions 

The primary objective of the present research was to 
investigate the feasibility of a multidimensional latent 
trait model. The motivation behind this research was a 
desire to determine whether the greac benefits realized 
through the use of unidimensional latent trait models could 
also be realized with a multidimensional model. A. two- 
parameter logistic latent trait model and its 
multidimensional extension were selected for this research. 

The design of the study employed two stages. The first 
stage consisted of generating simulation data to fit the 
multidimensional extension of the two-parameter logistic 
(M2PL) model, applying the model to the data, and comparing 
the. resulting estimates with the known parameters. The 
unidimensional two-parameter logistic (2PL) model was also 
applied to these- data . In addition to comparing the 
estimated parameters with the true parameters, the fit of 
the 2PL and M2PL models to the data were compared. ' The 
second stage of the study employed real response data . , 
Items were selected from various subtests of a larger test 
that had been administered to a large sample in such a way 
as to simulate shorter tests with varying numbers of 
subtests. The 2PL and M2PL models were applied to these 
data, and the resulting estimates were used to evaluate the 
fit of the models to the data. The fit of the two models to 
the data were then compared to determine whether the M2PL 
model more adequately modeled the real data than did the 2PL 
model. 

The results of^he analysis of the simulation data 
indicated that the parameters of the M2PL model could be 
' accurately estimated. The results of the goodness of fit 
analyses indicated 'that the M2PL model could more adequately 
model simulated multidimensional response data than did the ' 
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2PL model. The increase in dimensionality of the simulation 
data did not greatly reduce the accuracy with which the 
parameters of the M2PL model could be estimated. 

The results of the analysis of the real test data 
indicated that the M2PL model also more adequately modeled 
multidimensional real data than did the 2PL model. The use 
of a M2PL model latent trait model does seem to be feasible,* 
and the advantages gained by using such models seem to be 
great enough to warrant further research into this area. 
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